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(54) Computer network 

(57) Each terminal (e.g. terminal 8) of a computer 
network 100 can monitor the activities of the other ter- 
minals 1 ,2,3,4,5,6,7; or associated equipment such as a 
telephone 15; and display these activities in visual 
and/or audible form. The display may be represented as 
a Virtual world", and/a a generative music system such 
as "Koan". The nature of the activities performed by the 
terminal 8 itself also control the display, for example giv- 
ing greatest prominence to those terminals engaged in 
similar or related activities. 



A terminal 3 may be configured to act as a specified 
user's "base" terminal, to display the activity of the spec- 
ified user, by identifying whether the specified user's 
identity is being used on another terminal (e.g. terminal 
4). The activity of this terminal can then be displayed on 
the "base" terminal 3. The base terminal 3 can therefore 
indicate the absent user's availability, level of activity etc 
to colleagues working nearby. 




Figure 1 
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Description 

[0001] This invention relates to computer networks 
and their operation. The use of computers is becoming 
increasingly common in all types of business. By linking s 
computers together through private networks (so-called 
Local Area Networks, or LANs) or a public network such 
as the "Internet'' it is possible for many people to co- 
operate on a project without being in each other's phys- 
ical presence. The individuate may be anywhere in the 10 
world, and still work together. Remote working in this 
way is known as "teleworking". 
[0002] A problem with teleworking is that the creative 
atmosphere of an office full of people is lost. While 
working in isolation can be productive for certain activi- is 
ties demanding peace and quiet, the ambience of an 
office or laboraory is better for generating informal and 
serendipitous associations. The problem of teleworking 
is that workers lose an awareness of what their col- 
leagues are doing, which can lead to a breakdown in 20 
company or group culture. 

[0003] According to one aspect of the invention, there 
is provided a computer network comprising a plurality of 
user terminals, each having means for performing a plu- 
rality of activities, means for identifying the activities 25 
performed by at least one first terminal, and means for 
displaying on at least one displaying terminal the activi- 
ties performed by the first terminal. Preferably each of a 
plurality of terminals is capable of displaying the activi- 
ties performed by the other members of that plurality. 30 
[0004] This invention allows distributed groups of peo- 
ple to maintain an awareness of each other. In one 
implementation the display on a first terminal is selected 
to be indicative of the relatedness of the activities per- 
formed by other terminals to those currently performed 35 
by the first terminal. The display may be visual, by 
means of a screen image, or audible, by means of 
sounds, or both. 

[0005] In another implementation, a computer termi- 
nal may be configured to track the activity of a specified 40 
user currently working elsewhere, for example by moni- 
toring the network and identifying whether that user's 
identity is being used on another terminal, and what 
activities are currently in use at that terminal. 
[0006] Various embodiments are envisaged within the *s 
scope of the invention. Several of these will be dis- 
cussed below, with reference to the accompanying 
drawings, in which: 

Figure 1 illustrates a typical computer network, so 
illustrating one terminal in detail. 
Figures 2 to 7 illustrates various screen images dis- 
played to a user of the system. 
Figures 8 and 9 are schematic diagrams illustrating 
a process for adding an audio input to the system. £5 

[0007] Figure 1 shows a network 100 serving several 
corrputers 1.2,3,4,5,6.7,8,9. (The same reference 



numerals will also be used to represent the users of 
these terminals, and avatars representing them in the 
Virtual environment" representation displayed by these 
computers). Links between the individual computers 
may be permanent hard-wired connections, virtual con- 
nections (permanent as perceived by the user, but pro- 
vided over shared lines by the telecommunications 
provider), or dial-up connections (available on demand, 
and provided on a pay-per-use basis), and may include 
radio links, for example to a mobile terminal 7. One of 
the computers (9) acts as a "server", co-ordinating the 
interactions of the other computers. This computer 9 
may also have similar functionality to the others, but as 
shown it is dedicated to the server function only. 
[0008] One of the computers (1) is shown in more 
detail. It comprises one or more input devices, such as 
a keyboard (1 1), mouse (12), and audio input (13). and 
means (14) for monitoring the activity of associated 
devices such as a telephone (15). it also comprises one 
or more output devices, such as a screen (16) and 
audio output (17). As is conventional, the computer (1) 
also comprises a memory (18) and a central processor 
(19). As will be understood, computer 2 has equivalent 
devices 21.22.23 etc., (not shown in detail), and simi- 
larly for corrputers 3,4,5,6.7.8. The computers 
1 ,2,3,4,5,6,7,8,9 do not all need to have all the input 
devices and output devices specified above. 
[0009] Each computer 1 ,2,3,4,5,6.7,8 communicates 
with the server computer 9 to arrange user access 
rights, and to define user groups. Any user 1 may 
instruct the server 9 to re-define his own user group to 
add or delete users. 

[0010] When a computer 1 is switched on, the user is 
requested to identify himself and the user identity is 
passed to the server computer 9. Whenever the user 1 
accesses a computer application, whether this requires 
the use of data from the server or only operations 
requiring the use of the computer's own memory 18 and 
central processor 19, the user's operation of this appli- 
cation is communicated to the server 9. The computer 1 
is also arranged to communicate to the server 9 certain 
other activities, such as keyboard strokes or the access- 
ing of specified computer files, indicative of the subject 
the individual user is currently working on. The activities 
to be communicated to the server 9 by the computer 1 
may be defined in the operating system of the computer 
1 . or by the server 9. 

[0011] The server computer 9 returns data to each 
user 1 relating to which other members 2,3,4,5.6,7,8 of 
the pre-defined user group are currently on-line, and 
information about the applications they currently have 
running, and their current subjects of interest This is 
represented to the user 1 on a display device, the repre- 
sentation being related also to the user's own current 
status, such that users 2,3,4.5,6,7,8 working on similar 
subjects to the user 1 can be readily identified. The rep- 
resentation may be generated either by the server 9 or 
by the user's own computer 1 . Example representations 
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will be described later. 

[001 2] in one particular embodiment a terminal 8 may 
be arranged to indicate the activity of a specified user. In 
general, it is envisaged that this will be the terminal at 
the user's own permanent work station. When that user s 
"signs in" at another terminal 7, the server recognises 
the user's identity and transmits a signal to the user's 
own terminal 8. causing a display to be generated indi- 
cating the location and activities of that user. This allows 
colleagues at the user's home location, where the termi- 10 
nal 8 is located, to monitor his activity and choose 
whether it is appropriate to contact him. 
[001 3] The activities monitored may include activities 
directly related to the user's operation of the computer 
1 , such as what subject the user is working on (identi- 75 
fied by the computer files the user is working on, the 
content of the document, webpage currently in use, key- 
words identified in the last few characters typed, and the 
applications the user has running), other activities 
which may take place at a work station, such as which 20 
input devices 1 1 . 1 2, 1 3 are in use, or whether a screen- 
saver is being displayed (a lack of activity suggesting 
that the user may be away from the computer), whether 
an associated telephone 15 is in use, or whether an 
audio input 13 is detecting voices, suggesting that the 25 
user is in conference. 

[001 4] The display on the screen 1 6 of the computer 
terminal 1 may take the form of a 'Virtual environment", 
(illustrated in Figures 2 to 7) in which users (including 
the user of the computer 1 himself) using associated 30 
applications are represented as being closer together 
than users working on disparate subjects. The view- 
point in the virtual environment will depend on the posi- 
tion of the user within it, which in turn depends on the 
subject that the user is working on. As the user operates 35 
the various input devices 1 1 , 1 2, 1 5 of his terminal 1 , the 
server 9 interprets these activities to control the user's 
poistion and viewpoint 

[0015] Sound effects may either supplement or 
replace the visual display to give an ambient sound 40 
effect which varies according to the context the user 1 is 
working in. These may be artificially generated sounds, 
prerecorded, or five sound transmitted from the other 
users' terminals 2,3,4,5,6,7,8. These sounds may be 
varied, for example in amplitude or pitch, according to 45 
the proximity in the virtual space of the users repre- 
sented by them. The use of sound has particular benefit 
in virtual environments in which part of the environment 
is out of the field of view of the user. Spatialised sound 
may be used to facilitate the location, by the user, of the so 
sound sources in the virtual environment Suitable spa- 
tialised systems are described for example in United 
States Patents 5533129 (Gefvert). 5307415 (Fosgate), 
article "Spatial Sound for Telepresence" by M.Hollier. D. 
Burraston, and A. Rimell in the British Telecom Technol- ss 
ogy Journal, October 1997, and the applicant's own 
pending European Patent Application 97304218.7 filed 
on 17th June 1997. 



[001 6] Several modes of operation of the system will 
now be described with reference to the drawings. In the 
first mode, represented in Figures 2 to 7, the user 
moves through a "virtual environment" which has a 
number of predetermined activities, and various levels 
at which the user can be operating on those activities. 
Users working on the same subject will appear near to 
each other in the world. 

[0017] The server 9 loads the virtual environment 
application into the user's terminal 1 , for display on the 
screen 16, and updates it in rsponse to the activities of 
the individual users 1,2,3,4,5,6,7,8. The virtual environ- 
ment is represented by a number of levels 400. 401. 
402. 403 (Figure 2). Each user 1 is represented on the 
corresponding screens 26. 36. 46 etc of the other users 
2, 3, 4 etc. The user 1 can navigate freely about the 
world, including moving between levels, and correspond 
with other users, using electronic mail, video confer- 
ence, or other available means. 
[001 8] The representation of the user's position, both 
on his own display device and those of the other users, 
is driven by the server 9 interpreting the activities of the 
user, tor example operation of the mouse 12. keyboard 
11, telephone 15, etc. 

[0019] The user is generally presented with a view- 
point of this virtual environment as seen from a ground 
level 400 (Figure 3), representative of his own desig- 
nated working area. Other users 2. 3, 4. 5, 6, 7, 8 in his 
designated user group are represented by "avatars" 
positioned inthe virtual space according to their current 
activities. The user 1 is initially represented in an open 
space, and arranged to be looking towards certain other 
users 2, 3, 4 in the user group selected to be those with 
whom the user shares some common interest, those 
currently working in similar subjects to the user 1 being 
arranged closest to the viewpoint of the user 1, whilst 
those who, although having the same interest, are cur- 
rently working in some other activity, are more remote. 
[0020] As shown in Figure 4, as the user 1 works on 
different subjects (identified by the server 9 according to 
the computer files and applications in use. key strokes, 
etc), his respective avatar is moved to a part of the vir- 
tual environment representing an "interest area" 201 
relating to that subject, and changed in appearance (for 
example colour) to reflect the fact that the user is busy. 
Avatars of other users 7,8 who share an interest in this 
subject will be located in the same interest area of the 
virtual environment, at an appropriate level to their cur- 
rent activities. 

[0021] If a user carries out an activity such as docu- 
ment downloading, searching the Internet or having a 
meeting, his avatar is moved to one of the other levels 
401, 402, 403, each representing one such activity. 
(Figure 2) Users from other groups engaged in similar 
activities will be found there. This allows interactions to 
take place between members of different interest 
groups when they are engaged on similar activities. This 
emulates the behaviour of personnel in a real office 
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environment, where workers from different working 
groups may discover matters of common interest durng 
chance encounters in common areas of the office such 
as in the comdor or by the photocopier, but would not 
wish to disturb each other when concentrating on work 
specific to their group. These matters of common inter- 
est may relate to the activity represented by the level the 
users meet on, but may be unconnected to it 
[0022] When a user first "logs on" to his terminal 1 to 
start a session,, the user first appears on an "entry" 
level 403, to allow such encounters to take place before 
the users get involved in more specialised activities at 
the "ground level" 400, and to gain an "overview" of who 
is already present in the virtual environment. (Figure 2). 
After a short interval, if the user does not initiate an 
interaction at this entry level, the saver 9 automatically 
moves the user 1 to the ground level 400. as shown in 
Figure 3. 

[0023] Sound may be used to support the visual infor- 
mation represented on the screen 16, and create a 
more lifelike ambience, tn a real office environment 
hearing is the primary awareness cue, and in an open 
office staff are usually aware of each other's presence 
even when they are not in view. The system is therefore 
arranged to provide an auditory awareness of specific 
people - for example the members of a specified group, 
and/or those nearby in the virtual environment. 
[0024] The users can navigate freely about the world. 
If the user 1 wishes to discuss matters relating to 
another interest group, he can navigate to the relevant 
interest group 301 on the ground plane 400. The user 
can then arrange to converse with another user 5 in that 
interest group, tor example using electronic mail, by 
identifying the relevant avatar and transmitting the 
required text. 

[0025] The user 1 may wish to enter a different mode 
of communication, e.g. an audio link, with the other user 
5. As shown in Figure 5, the user 1 selects the two ava- 
tars 1 .5 (for example by using a "mouse" 1 2 to "click" on 
the respective avatars, and entering a command to 
cause the server 9 to set up a telephone connection 
between the user* respective telephones 15. 55. or the 
audio input/output devices 13, 17. 53. 57. The other 
people 6,7 nearby in the virtual environment receive a 
visual indication that the two users 1 .5 are in audio com- 
munication, by the representation of an "audio zone" 
101 surrounding their avatars 1,5. The users 1,5 may 
select the discussion to be private, or alternatively may 
allow the server 9 to arrange for part of the conversation 
may be fed (at low bit rate and amplitude) into the audio 
outputs 27, 37, 47 etc of the other users, so that another 
user e.g. user 6, can "overhear", the conversation and 
join in if he wishes to contribute. To do so, the user 6 
moves into the audio zone' 101, for example by moving 
his avatar under control of his mouse 62. The server 9 
responds to this movement by connecting user 6, by 
means of his telephone 65 or other audio devices 63, 67 
at full bandwidth, to enter the conference. 



[0026] Any of the users 1 , 5, 6 can, if desired, cause 
the discussion to continue in a more formal "virtual 
meeting space" 102, for example of the type described 
in the applicant's earlier European Patent Specification 

5 97309926 filed on December 9th 1 997, and illustrated in 
Figure 6. This system has facilities such as a shared 
whiteboard, document distribution, document sharing, 
etc. Any of the users 1 , 5, or 6 can create the "meeting 
space" 102 by entering an appropriate command using 

10 an input device (e.g. the respective "mouse" 12, 52, 62) 
to instruct the server 9 (or one of the individual user 
equipments 1,5.6) to activate the meeting space appli- 
cation, and to instruct the individual user equipments 
1,5,6 to interact with the meeting space application to 

is display to each user, using their respective display 
devices 16, 17, 56, 57, 66, 67, the activities of the users 
1 ,5.6 within the meeting space 102, as indicated by the 
individual users' use of their respective input devices 
(11, 12, 13, 51,52, 53, 61,62, 63). 

20 [0027] As the meeting space application 102 is acti- 
vated, various conferencing tools appear such as a 
table 131, whiteboard 132 and so on and the avatars 
1,5,6 start to 'act out the interactions between each 
other. As shown in Figure 6 the meeting space 102 is 

25 displayed to each user 1 , 5, 6 from the viewpoint of that 
respective user, so the user to whom it is displayed 
(user 1 in mis example) does not appear. Other people 
2,3,4 in the social space, not involved in the meeting, 
are given an indication that the users 1 ,5,6 are in a pri- 

30 vate meeting and cannot overhear any of the discussion 
(Figure 7). These other users 2,3,4 are not represented 
in the meeting space 102, although the overall virtual 
environment 100 may be represented in a "window". 
[0028] Any user 5 in the meeting space 1 02 can show 

36 a document to the other users 1.6, in the space by 
entering the details of the document, and a representa- 
tion 133, 133a of the document then appears on the 
table in front of each avatar 1 ,5.6. A user can select the 
document (by "clicking" on its representation 133 and 

40 the document appears in a two dimensional "window" in 
the resepctive display 16. 56. 66 for him to read. 
[0029] A user 6 may take notes by "clicking" on a rep- 
resentation of a whiteboard 132. causing the respective 
avatar 6 to move to the whiteboard in the veiwpoint of 

45 the other users 1 ,5. whilst the user 6 is presented with a 
full-screen image of the whiteboard on which text, etc, 
can be entered. 

[0030] Users may leave the meeting space 102, or 
request admission, at any time - their departure from 

so and entry to the meeting space 102 being represented 
by appropriate movement of the avatars in the repre- 
sentations of the overall virtual environment 100 or 
meeting space 102 displayed to each user 
1 ,2.3,4,5,6,7,8, in the same way as the audio zone 101 

55 can be entered and left, except that access to the meet- 
ing zone 102 may be refused by the current occupants 
of the meeting zone. If the meeting is dosed, the meet- 
ing space 102 is replaced by an informal audio zone 
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101 similar to that of Figure 5, surrounding any partici- towards the sound, and hit a button on the keyboard 11. 
pants 1 ,5 present in the meeting zone 102 at the time of The current position of the seat is used by the computer 
c,osure - 1 to identify the required user 2, causing the telephone 
[0031 ] If a first user 1 wishes to contact another spe- 1 5 to ring that user's telephone 25. 
cific user 2, but does not know when the other user 2 is s [0035] The audible output may be conventional audi- 
available, the first user 1 selects the avatar of the other bie icons - individual "beeps* to indicate events such as 
user 2, and the server 9 generates a sound output rep- electronic mail arriving, or continuous sound represent- 
resentative of the current activity of the other user 2. ative of individual users, such as the background sound 
This sound output changes when the other user 2 representative of each user currently logged on. Audi- 
becomes available. For example when the other user is 10 tory icons are ideal for alerting users to particular 
available a background noise' is generated, representa- events, but they are less good at conveying continuous 
tive of the other user 2. This background noise could be states. While it is useful to have a sound to indicate that 
a sample of speech, or a low bit-rate audio feed could some new email has arrived in a virtual office environ- 
be used - ment. it may become distracting if that sound was 
[0032] The server 9 infers the availability of the user 2 is played continuously until the email is read. If sounds 
based on the applications running on the respective were used to convey other events and states in the 
computer, the frequency of key presses on the keyboard office environment such as forthcoming meetings. 
21 , whether the telephone 25 is in use, the level 400. changes in important documents, the availability of col- 
401 , 402 etc the user 2 is currently assigned to etc. The leagues, etc.. then it may become difficult to extract any 
degree of availability may be used to vary audio ampli- 20 information at all from the mixture of noises, 
tude or other characteristics, to indicate how likely the [0036] For example the presence of mail in a mailbox, 
user 2 is to welcome an interruption. If the user 2 is not the approach of a scheduled appointment, and the 
currently logged on, the sound level is zero. whereabouts of nearby users in the virtual environment 
[0033] The system may also be used as an "intelli- who are outside the user's field of vision, or too distant 
gent" screen saver. A computer terminal 3 is allocated 25 to identify readily given the picture resolution of a typical 
to a respective user. When the user is working else- computer monitor, are all characteristics which may 
where the system is configured such that it reflects his require low-level continuous indications, rather than a 
availability. So for example, if the user is currently work- single sound to indicate an event. The sound may be 
ing at another terminal 4, for example at home, but is modified according to the significance of the event - for 
willing to be contacted, he can select an 'at work' option, 30 example the number or urgency of messages, the prox- 
causing the terminal 4 to log on to the server 9 in the imity of the appointment, etc. may be indicated by the 
conventional way. The server 9 transmits an instruction amplitude, pitch, a repetition rate of a sound, 
to the terminal 3 to display a graphic or avatar of the [0037] This requires a structured approach to deliver- 
user at a computer. The server 9. by monitoring the ing auditory information that allows the sound to be 
operation of the terminal 4. can cause the graphic on as organised. A particular example of a continuous indica- 
te display 37 to indicate the applications being run. tion is music, which can be considered as a system for 
Thus people in the office would be able to see from the organising sounds so that the combination of sounds is 
display 37 on his office terminal 3 that the user is at capable of conveying meaning, and its use in a virtual 
home and available to be contacted, should he choose environment is comparable to the way music is used to 
to make this known. Similarly, when the user picks up 40 support the action in theatre, opera and particularly cin- 
the telephone 45 (as sensed by the telephone 45 itself ema films. Music as a display device is ideally suited to 
or at the exchange) the avatar on the display 37 a virtual environment as. unlike a purely graphical sys- 
changes so that people know that the user is unavaiia- tern, H can subtly convey non-specific information wim- 
ble to be telephoned, but perhaps still available to be out requiring the listener's full attention. This means that 
emailed. If both computers 3, 4 have video conferencing 45 as long as the main focus of the work is visually based 
capabilities, the system may be arranged such that a (e.g. word processing, programming etc.) the music is 
user in the office can establish a video conference with able to exist alongside the main work activity without 
the user 3 by entering a simple commnd.. causing interruption. 

[0034] Spatialised audio, of the type described in [0038] The use of music in theatre and opera is many 

European Patent application application 97307663. 1 so centuries old, and is also well established in f flms. There 

filed on September 25th 1997. which uses a plurality of can be little doubt that music can change the sense of 

audio ouputs 17 in connection with a movable seat and environment For example, an apparently innocuous 

screen, whose position is monitored by the computer beach scene in the film "Jaws" (1975) is completely 

equipment 1 . may be used to track the user 2 in the vir- altered by the accompanying music, which alone hints 

tual environment, and to make audio connections based ss at the sinister approach of the unseen shark. The infor- 

on which sample or low bit rate audio awareness chan- mation in the virtual environment can also be repre- 

nel the user 1 is currently facing. For example, the user sented using music; each different user of the 

1. hearing the voice of user 2, can turn in his seat environment having a particular theme associated with 
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him/her, the rhythm of which is altered to indicate if that 
person is busy or not. The music provides a continuous 
indication of the user's level of activity. Clearly it would 
be distracting were users required to repeatedly check 
the environment visually to assess the activity of the 5 
other users, so the music is provided to provide an 
ambient awareness of what's going on, to enhance the 
environment rather than to replace it. allowing users to 
gain visual confirmation of events detected through the 
music. 10 
[0039] However, although there are many similarities 
between virtual environments and films, there is clearly 
one major difference. All of the action that takes place in 
a film is scripted and pre-planned whereas in an interac- 
tive shared virtual environment much of the content and is 
activity cannot be foreseen. Thus the score accompany- 
ing a dynamic virtual environment must itself be 
dynamic and change according to the action taking 
place. It is possible to provide each event, user, etc, with 
a musical segment or leitmotif which is played in given 20 
circumstances. However, this is difficult to arrange and 
likely to lead to a confused sound, drffuicuft to under- 
stand, especially when a lot of activity is taking place. 
[0040] In a preferred arrangement according to the 
invention, music is used that does not rely on segments 25 
being prepared in advance, but can generate music in 
real time based on the states and events taking place. 
"Generative music" is a term used to describe music 
that is composed by a computer in real time based on a 
set of static or changing rules and parameters. The 30 
music is defined (written) by setting parameters and 
rules that affect the system's random choices of note 
pitch, length, rhythm, instrument etc. One particular pre- 
ferred implementation uses computer-generated music, 
such as "Koan", discussed on the SSEYO website at 35 
httpy/www.sseyo.com. This application runs on a PC 
and uses a mid soundcard to produce the music. Koan 
has built into it many of the rules and organising struc- 
tures that allow recognisable musical styles to be gener- 
ated easily, including common western scales as well 40 
as Indian and Asian forms. This means that pieces of 
music can be created that will always conform to these 
styles but which can have any variety of component 
parts. The Koan system allows the composer to select 
from over 200 different musical parameters ranging 45 
from note tength/jsitch through to advanced features of 
mid sound cards, which can be altered to produce a 
huge variety of different sounds and musical styles. The 
system to be described here replaces the human com- 
poser by an input from the virtual environment 100, so 
which selects the parameters to be input to the system. 
[0041] In a shared environment where music is used 
to identify people and their level of activity, the use of a 
generative music system allows musical parts to be 
defined for each level of activity for each person. In this ss 
method however the parts are not explicitly created, but 
parameters are set so that the system produces music 
for each person that will sound similar each time it is 



played. The advantage of the generative method is that 
it is possble to associate the different levels of activity 
directly with the parameter that controls the pitch of the 
notes. This means that the number of levels of activity 
does not need to be known in advance, and separate 
pieces donl need to be created for each possible state. 
The generative system is able to cope with any number 
of different states and translate this into a continuous 
variation in the pitch (or other parameter) of the parts. 
[0042] Clearly it is feasible to represent information 
from many sources as changes in the musical composi- 
tion, but the Koan system is a more scaleabte technique 
that relies on less musical knowledge. The problem 
becomes merely one of collecting the information and 
deciding which musical feature to associate it with, the 
generative music application organises the sounds into 
a coherent output. 

[0043] In a practical implementation, shown in Figures 

8 and 9, a JAVA applet 901 is used to set up communi- 
cation between the virtual environment 902 and the 
music application 903. Events in the virtual environment 
902 are passed to the applet 901 which then sends the 
appropriate messages to alter the behaviour of the 
music application 903. Likewise, changes occurring in 
the music application 903 may be passed back to the 
virtual environment 902 using the applet 901 , for exam- 
ple to control the direction of a sound source. 

[0044] An event occurring in the virtual environment 
system causes a program to be run (either in the server 

9 or in an individual terminal 1) that consults a look-up 
table 910 to determine which musical segment 911, 

912 91 N should be used to represent this event. The 

selected segment 91 N is then added to any other seg- 
ments (92N, 93IM, etc) already selected to be part of the 
music to be played by the music application 903. The 
music application 903 combines the selected segments 
to generate the musical output The interactions 
between the segments may be quite complex - the addi- 
tion of one segment may modify the way in which others 
are presented. The selected segments 91 N, 92N, 93N 
continue to play, continuously or periodically, until the 
system determines that another event has occurred 
requiring a segment to be added or deleted. Certain 
events may require a segment to exhibit a temporal 
characteristic, for example getting louder or softer or 
changing in pitch, according to how recently the associ- 
ated event occurred. 

Claims 

1. A computer network comprising a plurality of user 
terminals, each having means for performing a plu- 
rality of activities, means for monitoring one or more 
of the terminals, and identifying the activities per- 
formed by the terminals so monitored, and means 
for displaying on at least one displaying terminal the 
activities performed by the monitored terminals. 
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2. A network according to claim 1 , wherein each of a 
plurality of terminals is capable of monitoring and 
displaying the activities performed by the other 
members of that plurality. 

5 

3. A network according to claim 1 or claim 2, wherein 
at least one displaying terminal is arranged to dis- 
play an indication of the relatedness of the activities 
performed by the respective monitored terminals to 
those currently performed by the display terminal. 10 

4. A network according to claim 3. wherein the display 
is visual. 

5. A network according to daim 3 or 4, wherein the is 
display is audible. 

6. A network according to claim 5, wherein the display 
comprises a generative music system. 

20 

7. A network according to any preceding claim, 
wherein at least a first terminal is configured as a 
tracking terminal to track the activity of a specified 
user currently working elsewhere. 

25 

8. A network according to claim 7 wherein the tracking 
terminal is arranged to monitor the network and 
identify whether the specified user's identity is 
being used on another terminal. 

30 

9. A network according to claim 8, wherein the track- 
ing terminal is arranged to identify the activities cur- 
rently in use at the said other terminal. 

10. A network according to any preceding claim, 35 
wherein the terminals interact through the operation 

of a server terminal, the activities of the, or each, 
monitored terminal being monitored by the server 
and reported to each displaying terminal. 

40 

11. A method of operating a computer network com- 
prising a plurality of user terminals, each having 
means for performing a plurality of activities, the 
method comprising the steps of monitoring one or 
more terminals, identifying the activities performed 45 
by the terminals so monitored, and displaying on at 
least one displaying terminal the activities per- 
formed by the monitored terminals. 
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